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© Image processing. 



© Apparatus for modifying part of an image represented digitally in the frequency domain comprises a first 
memory (29) for storing a representation of the image digitally in the frequency domain as at least one first block 
of data locations containing frequency coefficient data. A second memory (30) is provided for storing a 
representation of the image part in the frequency domain by second blocks of data locations containing 
frequency coefficient data, the first aid second blocks representing, after conversion to the spacial domain, 
spatially shifted versions of the image part relative to a fixed spatial co-ordinate system. A suitably programmed 
computer (31) applies a predetermined shift function defined in the frequency domain to the or each first block 
of data stored in the first memory (29) to generate the or each second block, and stores the resultant second 
blocks of data in the second memory (30). 
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IMAGE PROCESSING 



The invention relates to methods and apparatus for moving an image relatively to a fixed coordinate 
system. The invention is particularly applicable to the movement of images relatively to one another in page 
planning systems. 

In conventional page planning systems, images are defined digitally as a number of arrays of pixels, 
data for each pixel defining the colour content of that pixel. Typically, for a coloured image, the colour 
content of a pixel will be defined in terms of the density of its different colour components (eg. cyan, 
magenta, yellow, and black) so that there are four arrays of data for each image. The page planning 
process involves determining the coordinates of each image on a final page and then copying from 
respective stores into each pixel of the final page data from the pixel of an image which is to be located at 
that position. 

Current image processing systems are able to define images at high resolutions of the order of 320 x 
320 pixels per square inch. Although this is particularly advantageous in accurately defining an image, it 
leads to the generation of a very large amount of data defining the content of each image. This leads to a 
particular problem when it is necessary to store the data or to transmit the data. To reduce this problem, it 
has recently been proposed to transform the colour density data for 8 x 8 pixel blocks into the frequency 
domain. The image is represented in the frequency domain by equivalent 8 x 8 blocks of data locations 
which define respective frequency coefficents. Typically, there is a zero order frequency coefficient defining 
a DC term together with a number of higher order AC coefficients. By defining the image in this way, the 
number of higher order frequency terms required to define a reasonably accurate representation of the 
image is much less than 64 (the largest possible number of coefficients). This enables the image to be 
stored or transmitted in a much more compressed form than the original spatial representation. 

When it is necessary to construct a page containing a number of images which have been compressed 
by conversion into the frequency domain, it has previously been necessary to decompress the images into 
the spatial domain and then to construct the final compposite page in the manner described above. This is 
computationally very demanding and needs a lot of buffer space in the page planning apparatus. 

In accordance with one aspect of the present invention, a method of modifying part of an image 
represented digitally in the frequency domain by at least one first block of data locations containing 
frequency coefficient data in which for each first block a second block of data locations containing 
frequency coefficient data is generated, the first and second blocks representing, after conversion to the 
spatial domain, spatially shifted versions of the image part relative to a fixed spatial coordinate system 
comprises applying a predetermined shift function defined in the frequency domain to the or each first 
block of data locations to generate the or each second block of data locations. 

This invention enables the decompression of a majority of the image to be avoided during page 
planning operations and the like by carrying out computations in the frequency domain. In practice, it will 
generally be necessary to decompress from the frequency domain to the spatial domain those blocks of 
data locations which include an edge of the image but. in general, these (edge) blocks represent a small 
proportion of the total number of blocks in an image. For example, if the image is formed by 800 x 800 
pixels and is divided into 8 x 8 blocks, there will be 400 edge blocks compared with nearly 10000 body 
(non-edge) blocks. 

The invention is based on the property that moving or shifting an image in the spatial domain relative to 
a fixed coordinate system corresponds in the frequency domain to simple multiplication by a filter shift 
function. Typically, after application of the shift function, each data location is modified to define a 
coefficient of a frequency different first the frequency whose coefficient was originally defined by the data 
location. 

Typically, the image part will be represented by a plurality of subsidiary blocks, the method comprising 
a preliminary step of forming one or more first blocks by combining groups of the subsidiary blocks. The 
combination of blocks of data in the frequency domain can be achieved in a variety of ways but one 
particularly convenient method is described in "Direct Computation of Higher-Order DCT Coefficients From 
Lower-Order DCT Coefficients" by B G Kashef and A Habibi. pages 425-431 of SPIE Vol 504 Applications 
of Digital limage Processing VII (1984). The advantage of combining the subsidiary blocks, which in one 
example are defined by 8 x 8 data locations, is that the number of computational steps can be reduced. 

In some examples, the shift function may comprise a two dimensional shift function but in the case 
where the image part is defined by an orthogonal array of first blocks of data locations, it is convenient to 
define the shift function by a single one dimensional shift function which is applied one or more times in 
each of the orthogonal directions. 
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In one example the method comprises 

a) applying the predetermined shift function to each first block of data locations to generate modified 
blocks in which the content of each data location is modified; 

b) determining the data locations in the modified first blocks which contribute to the content of each 
5 second block of data locations; and 

c) for each said second block which does not define an edge of the shifted image summing the 
coefficients of each frequency as defined by the content of those data locations of the modified first blocks 
which are determined to contribute to said second block to generate resultant coefficients for each 
frequency, and storing the resultant coefficients in respective data locations of the second block. 

w Preferably, the inverse transform of the shift function comprises a one or two dimensional delta function. 
This shift function in the frequency domain causes a simple phase shift of the frequencies within each block 
of data locations by suitable, modifying the stored coefficients. The exact form of the shift function is 
predetermined in accordance with the degree of movement required. 

It should be understood that each "first block" will generally form one of a number of first blocks of the 

is same size each defining a respective colour component of the image in the frequency domain. Furthermore, 
each first block may be represented by two equivalent blocks where the transformation from the spatial 
domain to the frequency domain results in the generation of real and imaginary components. An example of 
such a transformation is a Fourier transformation. Other transformations such as a cosine transformation 
result only in real coefficients. The shift function is chosen to correspond with the appropriate transform 

20 function so as to have real and imaginary parts or a real part only as appropriate. 
The original blocks may have the same shape or could differ in shape. 

The invention is particularly applicable for use in page planning methods in which the second blocks 
are defined in an array of blocks some of which define other images, the complete array defining a 
composite page. 

25 In accordance with a second aspect of the present invention, apparatus for modifying parts of an image 
represented digitally in the frequency domain comprises a first memory for storing a representation of the 
image digitally in the frequency domain as at least one first block of data locations containing frequency 
coefficient data; a second memory for storing a representation of the image part in the frequency domain 
by second blocks of data locations containing frequency coefficient data, the first and second blocks 

30 representing, after conversion to the spatial domain, spatially shifted versions of the image part relative to 8 
fixed spatial coordinate system; and processing means for applying a predetermined shift function defined 
in the frequency domain to the or each first block of data stored in the first memory to generate the or each 
second block, and for storing the resultant second blocks of data in the second memory. 

Tlie first and second memories may comprise separate hardware components or different parts of a 

35 common memory. 

Typically, the processing means comprises a suitably programmed computer. 

Examples of a page planning apparatus and methods in accordance with the present invention will now 
be described with reference to the accompanying drawings, in which:- 

Rgure 1 illustrates portions of two images which are to be positioned on the same page and. in 
40 phantom, indicates the final position of the second image relatively to the first image; 

Figures 2A-2C illustrate graphically the application of a shift function in the spatial domain to the 
second image; 

Figures 3A and 3B illustrate graphically part of the image and the shift function of Figures 2A and 2B 
in the frequency domain; 
45 Figure 4 is a block diagram of the apparatus; and 

Figure 5 illustrates a first block of data locations made up from a number of subsidiary blocks of 
different sizes. 

In a typical page planning operation, a number of images are stored separately in digital form ready to 
be combined into a composite page. Each image is defined by a large number of pixels, the digital content 

so of each pixel defining its colour content For example, in the case of a coloured image, each pixel will be 
defined by three or four digital values representing the colour component densities (eg. cyan, magenta, 
yellow, and black). In view of the large amount of data this requires to be stored and the consequent large 
size for suitable memories, it is common practice to transform this data defining the images in the spatial 
domain into data defining the images in the frequency domain. To achieve this transformation, each image 

55 is divided into blocks of pixels, typically 8 x 8 pixels. Figure 1 illustrates part of a first image 20 defined by 
a primary array of 8 x 8 pixel blocks labelled 1-12. These blocks are positioned in a first array having 
boundaries at coordinate positions X0-X3. Y0-Y3 etc of a fixed spatial coordinate system. 

A second image 21 is also defined by an array of 8 x 8 pixel blocks labelled A-F in Figure 1. These 
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'ZTL? a \ ^ Separate <* a ^mon memory or in separate memories (as will be 

described below). The spatial location of boundaries of the blocks of each image lie. in this simple example 
or, the same lines and it will be seen that the top left hand comer of image 21 is positioned at coordinates 

5 < J n J? fr ! qUenCy domain - co,our content of block of pixels is defined by corresponding blocks 
of data locates in terms of a single (or two where the transform leads to real and imaginary parts) DC 
coefficient and a numter of AC coefficents for each higher order frequency. The coefficients are arranged in 
the same order .n each block. H should be understood that there is one set of these components foreach 
colour separation. In the frequency domain, a majority of the significant data defining the content of the 8 * 

w 8 pixel block .s contained in the first few coefficients. It is therefore possible to set to zero several of the 
rngher order coefficients without losing significant image detail and this leads to a significant deoree of 
compression of the data. 

In this example, it is desired to shift image 21 relative to image 20 so that image 21 partially overlaps 

« TmSv « 1 " 5 "* 9 01 image ^ 17,9 resultant P 08 ^ of ima 9° 21 after this shift is indicated bya 
'5 dashed line 22. 

In the past a shift of this type has necessitated converting the representations of the images from the 
frequency domain to the spatial domain and then replacing each relevant pixel in an image 20 pixel block 
by the corresrjonding pixel from image 21. In the example shown in Figure 1. it is desired to move image 
21 5 pixels in the Y direction and 5 pixels in the X direction so that the pixel blocks A-F are positioned* 
locations A-P defining a secondary array offset from the primary array. In a typical conventional shift 
operation, the data from pixel 23 is inserted into pixel 24 of pixel block 1 of image 20. This is repeated for 
each pixel in image 2 to generate a resultant composite page defined in terms of image 20 blocks which if 
necessary can then be reconverted into the frequency domain. ' 

The inventors have recognised that although the conventional process of pixel replacement in the 
spatial domain may still be necessary for those blocks of the primary array which are to contain anedoeof 
•mage 21 it is possible considerably to simplify the process for those blocks of the primary array which 
after the shift, contain solely portions of image 21. An example of such a block is the block 6 It will be seen 
from Figure 1 that after the required shift of image 21. block 6 of the first array contains 9 pixels (indudino 
pixel 23) from onginal block A. 15 pixels from original block B. 15 pixels from original block D and 25 pixels 
a» from onginal block E. The inventors have found that the resultant content of block A can be determined 
from , the representation of image 21 in the frequency domain without the intermediate step of convert™ 
this information back into the spatial domain. v 
The shift of a block of image 21 can be considered in one dimension to be the convolution of a function 
defining the block (figure 2A) with a delta function (figure 2B) yielding a shifted block functions (Figure 
„ eqUef1Cy domain ' convolution is equivalent to nullification so that this shift is equivalent to the 

mutopl.cat.on of a frequency function (having real and imaginary parts a, b) defining the block (figure 3A) 
by the transform of a delta function (figure 3B having real and imaginary parts c. d) to yield a shifted 
frequency function. This function has the form: ' y 
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cos ts + sin its + i ( cos is - sin its ) 
(1 - k/s) (l - k/s) 



« Although the blocks of data locations are two dimensional, the application of the shift function can be 
earned out in a series of one dimensional multiplication steps due to the separable nature of the 
fransforrned data. Where a Fourier transform is used to convert the data from the spatial to the frequency 
domain, the data will have both real and imaginary components and thus the transformed delta function will 
ato have real and imaginary components 25. 26 which multiply the real and imaginary components of the 

50 J^ l' h ^ case of some other transforms, such as a cosine transform, only a real component is 
generated and so the transform of the delta function will only be a real function 

In one example, the shift function is applied to each 8 * 8 "body- block. After application of the shift 
function in the frequency domain (ie. multiplication by the shift function) the content of the data locations of 
each body block of image 21 has been modified (unless it was previously zero) 

56 ^- lt k i !* e " necessary to deterrnin8 »or each new block of the primary array defining the shifted image 21 
whichjtote to^ons are needed to define the block. As previously mentioned, the block 6. after image 21 
has been shifted, is made up by contributions from blocks A. B. D. and E of image 21 Thus the 5 * 5 
block of data locations 27 within block 6 correspond to the 5 * 5 block of data locations 28 in' block E of 
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image 21 after modification by the shift function. 

Sir™ is — - in ■ ~ ^ — Tcrxi^sit: 

70 R 9"re 4 illustrates schematically apparatus for carrvino out tt» * 

be combined are stored in resoecni *nm»s» \n^T? method ascribed. The two images to 

The microprocessor » i^S^^TSE S CT*" 31 8 ^ p,8nnin ° untt * 
mentor 34 and a conve^oTo^ngtbi T^^^T^J' * 8,80 "* * 

composite page in terms of the pn^array^TnTme^ry S m ' CT0proC8S80r 31 *• 

positions are noStT me SS)Ze^r 31 in^'^ 68 f^"* ^ °" ^ fi " isned These 
may be defined, for Z££%T£2L?£ rZrTZ IT" ^ ^ ^ * ^ 
microprocessor 31 then determined ^ToftoTt^rfJZlZ ^ * imafle ^ ^ 

in the frequency domain by X£ ^t2ofo^ T 21 to 

and stores the modified data in tSe Sm ^^ZT^^ ZZlT^^^ £f* 
m the composite page memory 36 equivalent to blocks 1 -I2«h- nTtho^i ^ block of data locations 
data selected either from the memory ^oTtl mlmoV^x^Tt^ T"**"* 

dimensional shift function is then aoolied to earh «f „ pap8r ment,oned A one 

representing a sh* in the Y .SrZ^eSn tESJJ?' dBta * 

terms of original bkx* sizes <*. 8 - 8 J£^£E?JSl fe^^^^ 
the horizontal direction fas seen in Rm.ro i\ ^ HZ , ™f raj ana a new series of first blocks extending in 
those between Z^l&l^ ££JZ ^ ^ ** " ***** *" 

In some circumstances, the blocks definina the imsm* 91 maw K ^ _ . 
dimension will be 16 data locationT block a*,, m the Figure 5 example, this transverse 
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the frequency domain to the or each first block of data locations to generate the or each second block of 
data locations. 2. A method according to claim 1, wherein the image part is defined by an orthogonal array 
of first blocks of data locations, the step of applying a shift function comprising applying a single one 
dimensional shift function one or more times in each of the orthogonal directions. 

3. A method according to dam 2, wherein the inverse transform of the shift function comprises a delta 
function. 

4. A method according to any of the preceding claims, the method comprising 

a) applying the predetermined shift function to each first block of data locations to generate modified 
blocks in which the content of each data location is modified; 

b) determining the data locations in the modified first blocks which contribute to the content of each 
second block of data locations; and 

c) for each said second block which does not define an edge of the shifted image summing the 
coefficients of each frequency as defined by the content of those data locations of the modified first blocks 
which are determined to contribute to said second block to generate resultant coefficients for each 
frequency, and storing the resultant coefficients in respective data locations of the second block. 

5. A method according to any of the preceding claims, wherein the first blocks have identical 
dimensions. 

6. Apparatus for modifying part of an image represented digitally in the frequency domain, the 
apparatus comprising a first memory (29) for storing a representation of the image digitally in the frequency 
domain as at least one first block of data locations containing frequency coefficient data; a second memory 
(30) for storing a representation of the image part in the frequency domain by second blocks of data 
locations containing frequency coefficient data, the first and second blocks representing, after conversion to 
the spatial domain, spatially shifted versions of the image part relative to a fixed spatial coordinate system; 
and processing means (31) for applying a predetermined shift function defined in the frequency domain to 
the or each first block of data stored in the first memory (29) to generate the or each second block, and for 
storing the resultant second blocks of data in the second memory (30) 

7. Apparatus according to claim 6, wherein the processing means (31) comprises a programmed 
computer. 

8. A computer programmed to carry out the steps of a method according to any of claims 1 to 5. 
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